REPORT  DOCUMENTATION  PAGE 


Form  Approved  OMB  NO.  0704-0188 


The  public  reporting  burden  for  this  collection  of  information  is  estimated  to  average  1  hour  per  response,  including  the  time  for  reviewing  instructions, 
searching  existing  data  sources,  gathering  and  maintaining  the  data  needed,  and  completing  and  reviewing  the  collection  of  information.  Send  comments 
regarding  this  burden  estimate  or  any  other  aspect  of  this  collection  of  information,  including  suggesstions  for  reducing  this  burden,  to  Washington 
Headquarters  Services,  Directorate  for  Information  Operations  and  Reports,  1215  Jefferson  Davis  Highway,  Suite  1204,  Arlington  VA,  22202-4302. 
Respondents  should  be  aware  that  notwithstanding  any  other  provision  of  law,  no  person  shall  be  subject  to  any  oenalty  for  failing  to  comply  with  a  collection 
of  information  if  it  does  not  display  a  currently  valid  OMB  control  number. 

PLEASE  DO  NOT  RETURN  YOUR  FORM  TO  THE  ABOVE  ADDRESS. 


2.  REPORT  TYPE 

Final  Report 


1.  REPORT  DATE  (DD-MM-YYYY) 

02-03-2016 


4.  TITLE  AND  SUBTITLE  5a.  CONTRACT  NUMBER 

Final  Report:  3D  Data  Acquisition  Platform  for  Human  Activity  W91  INF-14-1-05 16 
Understanding  5b.  GRANT  NUMBER 


3.  DATES  COVERED  (From  -  To) 

25-Jul-2014  -  24-Jul-2015 


6.  AUTHORS 
Yun  Fu 


5c.  PROGRAM  ELEMENT  NUMBER 
611103 


5d.  PROJECT  NUMBER 


5e.  TASK  NUMBER 


5f.  WORK  UNIT  NUMBER 


7.  PERFORMING  ORGANIZATION  NAMES  AND  ADDRESSES 

Northeastern  University 
360  Huntington  Avenue 
490  RP 

Boston,  MA  02115  -5005 


9.  SPONSORING/MONITORING  AGENCY  NAME(S)  AND  ADDRESS 
(ES) 

U.S.  Army  Research  Office 
P.O.Box  12211 

Research  Triangle  Park,  NC  27709-2211 


8.  PERFORMING  ORGANIZATION  REPORT 
NUMBER 


10.  SPONSOR/MONITOR'S  ACRONYM(S) 
ARO 


11.  SPONSOR/MONITOR'S  REPORT 
NUMBER(S) 

65030-CS-RIP.2 


12.  DISTRIBUTION  AVAIL1BILITY  STATEMENT 
Approved  for  Public  Release;  Distribution  Unlimited 


13.  SUPPLEMENTARY  NOTES 

The  views,  opinions  and/or  findings  contained  in  this  report  are  those  of  the  author(s)  and  should  not  contrued  as  an  official  Department 
of  the  Army  position,  policy  or  decision,  unless  so  designated  by  other  documentation. 


14.  ABSTRACT 

In  this  project,  we  incorporated  motion  capture  devices,  3D  vision  sensors,  and  EMG  sensors  to  cross  validate 
multimodality  data  acquisition,  and  address  fundamental  research  problems  of  representation  and  invariant 
description  of 

3D  data,  human  motion  modeling  and  applications  of  human  activity  analysis,  and  computational  optimization  of 
large-scale  3D  data.  The  support  for  the  acquisition  of  such  research  instrumentation  have  significantly  facilitated 


15.  SUBJECT  TERMS 

Data  Acquisition,  Human  Activity  Understanding 


16.  SECURITY  CLASSIFICATION  OF: 

17.  LIMITATION  OF 

15.  NUMBER 

a.  REPORT 

b.  ABSTRACT 

c.  THIS  PAGE 

ABSTRACT 

OF  PAGES 

UU 

UU 

UU 

UU 

Yun  Fu 


19b.  TELEPHONE  NUMBER 
617-373-7328 


Standard  Form  298  (Rev  8/98) 
Prescribed  by  ANSI  Std.  Z39.18 


Report  Title 

Final  Report:  3D  Data  Acquisition  Platform  for  Human  Activity  Understanding 

ABSTRACT 

tn  this  project,  we  incorporated  motion  capture  devices,  3D  vision  sensors,  and  EMG  sensors  to  cross  validate  multimodality  data 
acquisition,  and  address  fundamental  research  problems  of  representation  and  invariant  description  of 

3D  data,  human  motion  modeling  and  applications  of  human  activity  analysis,  and  computational  optimization  of  large-scale  3D  data.  The 
support  for  the  acquisition  of  such  research  instrumentation  have  significantly  facilitated 

our  current  and  future  research  and  educate  scientists  and  engineers  in  areas  important  to  national  defense  and  the  DoD’s  mission. 


Enter  List  of  papers  submitted  or  published  that  acknowledge  ARO  support  from  the  start  of 
the  project  to  the  date  of  this  printing.  List  the  papers,  including  journal  references,  in  the 
following  categories: 

(a)  Papers  published  in  peer-reviewed  journals  (N/A  for  none) 


Received  Paper 


TOTAL: 


Number  of  Papers  published  in  peer-reviewed  journals: 


(b)  Papers  published  in  non-peer-reviewed  journals  (N/A  for  none) 


Received  Paper 


TOTAL: 


Number  of  Papers  published  in  non  peer-reviewed  journals: 


(c)  Presentations 


Number  of  Presentations:  0.00 

Non  Peer-Reviewed  Conference  Proceeding  publications  (other  than  abstracts): 


Received  Paper 


TOTAL: 


Number  of  Non  Peer-Reviewed  Conference  Proceeding  publications  (other  than  abstracts): 

Peer-Reviewed  Conference  Proceeding  publications  (other  than  abstracts): 


Received  Paper 


TOTAL: 


Number  of  Peer-Reviewed  Conference  Proceeding  publications  (other  than  abstracts): 

(d)  Manuscripts 


Received  Paper 


TOTAL: 


Number  of  Manuscripts: 


Books 

Received  Book 

03/02/2016  1  00  Yun  Fu  .  Human  Activity  Recognition  and  Prediction,  Switzerland:  Springer  International  Publishing, 
(01  2016) 

TOTAL:  1 


Received 


Book  Chapter 


TOTAL: 


Patents  Submitted 


Patents  Awarded 


Awards 

Dr.  Fu  was  elected  as  a  member  of  Global  Young  Academy. 

Dr.  Fu  was  recognized  by  the  IEEE  Computational  Intelligence  Society  (CIS)  as  the  awardee  of  2016  IEEE  CIS  Outstanding 
Early  Career  Award,  for  contributions  to  neural  computing,  manifold  learning,  and  visual  intelligence. 

Dr.  Fu  was  selected  as  one  of  the  2015  National  Academy  of  Engineering  US  Frontiers  of  Engineering  by  NAE. 

Dr.  Fu  was  elected  to  be  Senior  Member  of  ACM. 

Dr.  Fu  received  2016  Adobe  Faculty  Research  Awards. 

Dr.  Fu  was  promoted  to  the  rank  of  Associate  Professor  with  Tenure. 

Former  Ph.D.  student  Li,  Kang's  dissertation  entitled  “Video  event  recognition  and  prediction  based  on  temporal  structure 
analysis”  has  been  featured  by  IEEE  Signal  Processing  society  eNews  in  the  year  2015  at  http://www. 
signalprocessingsociety.org/newsletter/category/ph-d-theses/page/ll/. 
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Scientific  Progress 

We  have  used  this  DURIP  award  to  facilitate  our  3D  Data  Acquisition  Platform.  We  have  acquired  major  instruments  such  as 
Vicon  MX-T40S  camera  system,  192  cores  of  HPC  computational  equipment,  and  Trigno  Wireless  EMG  system  with  16  Trigno 
EMG+XYZ  sensors  from  Delsys.  Current  platform  is  sufficient  to  incorporate  both  motion  capture  devices  and  3D  vision  sensors 
to  cross  validate  multimodality  data  acquisition,  and  address  fundamental  research  problems  of  representation  and  invariant 
description  of  3D  data,  human  motion  modeling  and  applications  of  human  activity  analysis,  and  computational  optimization  of 
large-scale  3D  data.  The  support  for  the  acquisition  of  such  equipment  has  significantly  facilitated  our  current  research  and 
educate  scientists  and  engineers  in  areas  important  to  national  defense.  We  are  using  this  platform  to  collecting  a  unique 
database  which  could  be  used  for  multimodality  sensor  fusion  for  human  motion  analysis,  action  recognition,  and  behavior 
understanding.  The  impact  of  this  award  will  last  long  as  the  new  facility  is  transforming  our  current  research  scope  and  in  the 
meanwhile  help  our  current  and  future  technology  transfer. 
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